The notion of “responsibility gap” with artificial intelligence (AI) was originally introduced in the philosophical debate to indicate the concern that “learning automata” may make more difficult or impossible to attribute moral culpability to persons for untoward events. Building on literature in moral and legal philosophy, and ethics of technology, the paper proposes a broader and more comprehensive analysis of the responsibility gap. The responsibility gap, it is argued, is not one problem but a set of at least four interconnected (...) problems – gaps in culpability, moral and public accountability, active responsibility—caused by different sources, some technical, other organisational, legal, ethical, and societal. Responsibility gaps may also happen with non-learning systems. The paper clarifies which aspect of AI may cause which gap in which form of responsibility, and why each of these gaps matter. It proposes a critical review of partial and non-satisfactory attempts to address the responsibility gap: those which present it as a new and intractable problem (“fatalism”), those which dismiss it as a false problem (“deflationism”), and those which reduce it to only one of its dimensions or sources and/or present it as a problem that can be solved by simply introducing new technical and/or legal tools (“solutionism”). The paper also outlines a more comprehensive approach to address the responsibility gaps with AI in their entirety, based on the idea of designing socio-technical systems for “meaningful human control", that is systems aligned with the relevant human reasons and capacities. (shrink)

In this paper, in line with the general framework of value-sensitive design, we aim to operationalize the general concept of “Meaningful Human Control” in order to pave the way for its translation into more specific design requirements. In particular, we focus on the operationalization of the first of the two conditions investigated: the so-called ‘tracking’ condition. Our investigation is led in relation to one specific subcase of automated system: dual-mode driving systems. First, we connect and compare meaningful human control with (...) a concept of control very popular in engineering and traffic psychology, and we explain to what extent tracking resembles and differs from it. This will help clarifying the extent to which the idea of meaningful human control is connected to, but also goes beyond, current notions of control in engineering and psychology. Second, we take the systematic analysis of practical reasoning as traditionally presented in the philosophy of human action and we adapt it to offer a general framework where different types of reasons and agents are identified according to their relation to an automated system’s behaviour. This framework is meant to help explaining what reasons and what agents play a role in controlling a given system, thereby enabling policy makers to produce usable guidelines and engineers to design systems that properly respond to selected human reasons. In the final part, we discuss a practical example of how our framework could be employed in designing automated driving systems. (shrink)

The paper has two goals. The first is presenting the main results of the recent report Ethics of Connected and Automated Vehicles: recommendations on road safety, privacy, fairness, explainability and responsibility written by the Horizon 2020 European Commission Expert Group to advise on specific ethical issues raised by driverless mobility, of which the author of this paper has been member and rapporteur. The second is presenting some broader ethical and philosophical implications of these recommendations, and using these to contribute to (...) the establishment of Ethics of Transportation as an independent branch of applied ethics. The recent debate on the ethics of Connected and Automated Vehicles presents a paradox and an opportunity. The paradox is the presence of a flourishing debate on the ethics of one very specific transportation technology without ethics of transportation being in itself a well-established academic discipline. The opportunity is that now that a spotlight has been switched on the ethical dimensions of CAVs it may be easier to establish a broader debate on ethics of transportation. While the 20 recommendations of the EU report are grouped in three macro-areas: road safety, data ethics, and responsibility, in this paper they will be grouped according to eight philosophical themes: Responsible Innovation, road justice, road safety, freedom, human control, privacy, data fairness, responsibility. These are proposed as the first topics for a new ethics of transportation. (shrink)

This book claims that artificial intelligence (AI) may affect our freedom at work, in our daily life, and in the political sphere. The author provides a philosophical framework to help make sense of and govern the ethical and political impact of AI in these domains. AI presents great opportunities and risks, raising the question of how to reap its potential benefits without endangering basic human and societal values. The author identifies three major risks for human freedom. First, AI offers employers (...) new forms of control of the workforce, opening the door to new forms of domination and exploitation. Second, it may reduce our capacity to remain in control of and responsible for our decisions and actions, thereby affecting our free will and moral responsibility. Third, it may increase the power of governments and tech companies to steer the political debate, thereby affecting the possibility of a free and inclusive political participation. The author claims that it is still possible to promote human freedom in our interactions with AI. This requires designing AI systems that help promote workers' freedom, strengthen human control and responsibility, and foster a free, active, and inclusive democratic participation. Human Freedom in the Age of Artificial Intelligence will be of interest to scholars and graduate students working on the ethics of technology, philosophy of technology, political philosophy, design, and artificial intelligence. (shrink)

How does the use of military drones affect the legal, political, and moral responsibility of different actors involved in their deployment and design? This volume offers a fresh contribution to the ethics of drone warfare by providing, for the first time, a systematic interdisciplinary discussion of different responsibility issues raised by military drones. The book discusses four main sets of questions: First, from a legal point of view, we analyse the ways in which the use of drones makes the attribution (...) of criminal responsibility to individuals for war crimes more complicated and what adjustments may be required in international criminal law and in military practices to avoid ’responsibility gaps’ in warfare. From a moral and political perspective, the volume looks at the conditions under which the use of military drones by states is impermissible, permissible, or even obligatory and what the responsibilities of a state in the use of drones towards both its citizens and potential targets are. From a socio-technical perspective, what kind of new human machine interaction might drones bring and which new kinds of shared agency and responsibility? Finally, we ask how the use of drones changes our conception of agency and responsibility. The book will be of interest to scholars and students in ethics and to those in law, politics and the military involved in the design, deployment and evaluation of military drones. (shrink)

We argue that lack of direct and conscious control is not, in principle, a reason to be afraid of machines in general and robots in particular: in order to articulate the ethical and political risks of increasing automation one must, therefore, tackle the difficult task of precisely delineating the theoretical and practical limits of sustainable delegation to robots.

How should autonomous vehicles be programmed to behave in the event of an unavoidable accident in which the only choice open is one between causing different damages or losses to different objects or persons? This paper addresses this ethical question starting from the normative principles elaborated in the law to regulate difficult choices in other emergency scenarios. In particular, the paper offers a rational reconstruction of some major principles and norms embedded in the Anglo-American jurisprudence and case law on the (...) “doctrine of necessity”; and assesses which, if any, of these principles and norms can be utilized to find reasonable guidelines for solving the ethical issue of the regulation of the programming of autonomous vehicles in emergency situations. The paper covers the following topics: the distinction between “justification” and “excuse”, the legal prohibition of intentional killing outside self-defence, the incommensurability of goods, and the legal constrains to the use of lethal force set by normative positions: obligations, responsibility, rights, and authority. For each of these principles and constrains the possible application to the programming of autonomous vehicles is discussed. Based on the analysis, some practical suggestions are offered. (shrink)

Artificial Intelligence (AI) is predicted to have a deep impact on the future of work and employment. The paper outlines a normative framework to understand and protect human freedom and justice in this transition. The proposed framework is based on four main ideas: going beyond the idea of a Basic Income to compensate the losers in the transition towards AI-driven work, towards a Responsible Innovation approach, in which the development of AI technologies is governed by an inclusive and deliberate societal (...) judgment; going beyond a philosophical conceptualisation of social justice only focused on the distribution of ‘primary goods’, towards one focused on the different goals, values, and virtues of various social practices (Walzer’s ‘spheres of justice’) and the different individual capabilities of persons (Sen’s ‘capabilities’); going beyond a classical understanding of capital, towards one explicitly including mental capacities as a source of value for AI-driven activities. In an effort to promote an interdisciplinary approach, the paper combines political and economic theories of freedom, justice and capital with recent approaches in applied ethics of technology, and starts applying its normative framework to some concrete example of AI-based systems: healthcare robotics, ‘citizen science’, social media and platform economy. (shrink)

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

David Shoemaker has claimed that a binary approach to moral responsibility leaves out something important, namely instances of marginal agency, cases where agents seem to be eligible for some responsibility responses but not others. In this paper we endorse and extend Shoemaker’s approach by presenting and discussing one more case of marginal agency not yet covered by Shoemaker or in the other literature on moral responsibility. Our case is that of Kenneth Parks, a Canadian man who drove a long way (...) to his mother-in-law’s and killed her in a state of somnambulism. We support our claim about Parks’ marginal responsibility in three steps: we first deny that Parks acts involuntarily as traditionally claimed in the legal literature; we then propose to extend Shoemaker’s analysis of marginal responsibility based on quality of will so as to include two other dimensions: the moral status of the agent and the actual causal effects of their actions; finally, we distinguish Parks’ marginal responsibility from four other existing concepts: “tracing”, diminished responsibility, causal responsibility, and moral disapproval without responsibility. (shrink)

The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim (...) that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how “designing for meaningful human control” constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation. (shrink)

This article introduces seven ethical issues raised by the introduction of artificial intelligence (AI) at work. Each ethical issue is presented in connection to broader and older philosophical topics as well as topics in the more specialised literature on applied ethics of technology. The seven issues are: (1) How to govern the impact of AI on job losses and other social issues raised by the reshaping of the job market? (2) AI may contribute to create new forms of oppression and (...) violation of rights of the workforce; (3) AI may negatively affect workers’ (moral) agency, autonomy or responsibility; (4) AI may create hidden labour, that is, economically valuable tasks are performed by human agents without their work being sufficiently recognised, rewarded or protected, with (technological) companies acquiring an unfair gain and an increasing socio-economic power over people; (5) To what extent can AI affect the opportunity for people to perform good or meaningful work, and how should meaningful work be defined in a pluralistic society? (6) The introduction of AI at work may have a broader impact on social values and norms; (7) Who is responsible for making AI have a positive rather than a negative impact on ethical and societal values? In addition to providing a critical introduction to the ethical debate on AI and the future of work, the article also positions on this broader ethical and philosophical map the five articles of The Journal of Ethics special issue ‘Artificial Intelligence and the Future of Work’. (shrink)

The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and institutions, not (...) hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding. (shrink)

When should humans enhance themselves? We try to answer this question by engaging in a conceptual analysis of the nature of different activities. We think that cognitive enhancement is morally impermissible in some practice-oriented activities, such as some educational activities, when it is the case both that cognitive enhancement would negatively affect the point of those activities and that we have good reasons to value that point. We then argue that cognitive enhancement should be allowed in two groups of cases, (...) namely in practice-oriented activities, such as recreational activities on which little moral value or social import hangs, and in some prominently goal-directed activities, such as high-responsibility professions, the goal of which has significant moral or social value. Finally, we argue that the use of efficacious and relatively safe cognitive enhancers may even be obligatory in those high-responsibility professions under certain special circumstances. (shrink)

Accountability and responsibility are key concepts in the academic and societal debate on Autonomous Weapon Systems, but these notions are often used as high-level overarching constructs and are not operationalised to be useful in practice. “Meaningful Human Control” is often mentioned as a requirement for the deployment of Autonomous Weapon Systems, but a common definition of what this notion means in practice, and a clear understanding of its relation with responsibility and accountability is also lacking. In this paper, we present (...) a definition of these concepts and describe the relations between accountability, responsibility, control and oversight in order to show how these notions are distinct but also connected. We focus on accountability as a particular form of responsibility—the obligation to explain one’s action to a forum—and we present three ways in which the introduction of Autonomous Weapon Systems may create “accountability gaps”. We propose a Framework for Comprehensive Human Oversight based on an engineering, socio-technical and governance perspective on control. Our main claim is that combining the control mechanisms at technical, socio-technical and governance levels will lead to comprehensive human oversight over Autonomous Weapon Systems which may ensure solid controllability and accountability for the behaviour of Autonomous Weapon Systems. Finally, we give an overview of the military control instruments that are currently used in the Netherlands and show the applicability of the comprehensive human oversight Framework to Autonomous Weapon Systems. Our analysis reveals two main gaps in the current control mechanisms as applied to Autonomous Weapon Systems. We have identified three first options as future work for the design of a control mechanism, one in the technological layer, one in the socio-technical layer and one the governance layer, in order to achieve comprehensive human oversight and ensure accountability over Autonomous Weapon Systems. (shrink)

This paper proposes that autonomous vehicles should be designed to reduce light pollution. In support of this specific proposal, a moral assessment of autonomous vehicles more comprehensive than the dilemmatic life-and-death questions of trolley problem-style situations is presented. The paper therefore consists of two interrelated arguments. The first is that autonomous vehicles are currently still a technology in development, and not one that has acquired its definitive shape, meaning the design of both the vehicles and the surrounding infrastructure is open-ended. (...) Design for values is utilized to articulate a path forward, by which engineering ethics should strive to incorporate values into a technology during its development phase. Second, it is argued that nighttime lighting—a critical supporting infrastructure—should be a prima facie consideration for autonomous vehicles during their development phase. It is shown that a reduction in light pollution, and more boldly a better balance of lighting and darkness, can be achieved via the design of future autonomous vehicles. Two case studies are examined through which autonomous vehicles may be designed for “driving in the dark.” Nighttime lighting issues are thus inserted into a broader ethics of autonomous vehicles, while simultaneously introducing questions of autonomous vehicles into debates about light pollution. (shrink)

We propose a multi-step evaluation schema designed to help procurement agencies and others to examine the ethical dimensions of autonomous systems to be applied in the security sector, including autonomous weapons systems.

The scope and mission of the history of science have been constant objects of reflection and debate within the profession. Recently, Lorraine Daston has called for a shift of focus: from the history of science to the history of knowledge. Such a move is an attempt at broadening the field and ridding it of the contradictions deriving from its modernist myth of origin and principle of demarcation. Taking the move from a pluralistic concept of medicine, the present paper explores the (...) actual and possible contributions that a history of knowledge can offer to the history of medicine in particular. As we will argue, the history of medicine has always been a history of knowledge, but for good reasons has always stuck to the concept of medicine as its object and problem throughout the ages, including the modern, scientific one. We argue that, in the history of medicine, the demarcation between scientific and non‐scientific represents an accident, but is not foundational as in the case of natural science. Furthermore, the history of medicine programmatically played a role in at least two academic domains (history proper and medical education), adjusting historical narratives of medical knowledge to its audience. Accordingly, we underscore that the history of both science and medicine, as traditionally defined, already provides room for almost the whole spectrum of approaches to history. Moreover, their different myths of origin can, and indeed must, be included in the reflexivity of the historical gaze. We argue that the position towards a history of science, medicine, or knowledge is not a question of narrative or theory, rather, it is a question of relevance and awareness of extant contexts. (shrink)

”Meaningful human control” is a term invented in the political and legal debate on autonomous weapons system, but it is nowadays also used in many other contexts. It is supposed to specify conditions under which an artificial system is under the right kind of control to avoid responsibility gaps: that is, situations in which no moral agent is responsible. Santoni de Sio and Van den Hoven have recently suggested a framework that can be used by system designers to operationalize (...) this kind of control. It is the purpose of this paper to facilitate further operationalization of ”meaningful human control”. -/- This paper consists of two parts. In the first part I resolve an ambiguity that plagues current operationalizations of MHC. One of the design conditions says that the system should track the reasons of the relevant agents. This condition is ambiguous between the kind of reasons involved. On one interpretation it says that a system should track motivating reasons, while it is concerned with normative reasons on the other. Current participants in the debate interpret the framework as being concerned with (something in the vicinity of) motivating reasons. I argue against this interpretation by showing that meaningful human control requires that a system tracks normative reasons. Moreover, I maintain that an operationalization of meaningful human control that fails to track the right kind of reasons is morally problematic.When this is properly understood, it can be shown that the framework of MHC is committed to the agent-relativity of reasons. More precisely, I argue in the second part of this paper that if the tracking condition of MHC plays an important role in responsibility attribution (as the proponents of the view maintain), then the framework is incompatible with first-order normative theories that hold that normative reasons are agent-neutral (such as many versions of consequentialism). In the final section I present three ways forward for the proponent of MHC as reason-responsiveness. (shrink)

Suppose a driverless car encounters a scenario where harm to at least one person is unavoidable and a choice about how to distribute harms between different persons is required. How should the driverless car be programmed to behave in this situation? I call this the moral design problem. Santoni de Sio defends a legal-philosophical approach to this problem, which aims to bring us to a consensus on the moral design problem despite our disagreements about which moral principles provide the (...) correct account of justified harm. He then articulates an answer to the moral design problem based on the legal doctrine of necessity. In this paper, I argue that Santoni de Sio’s answer to the moral design problem does not achieve the aim of the legal-philosophical approach. This is because his answer relies on moral principles which, at least, utilitarians have reason to reject. I then articulate an alternative reading of the doctrine of necessity, and construct a partial answer to the moral design problem based on this. I argue that utilitarians, contractualists and deontologists can agree on this partial answer, even if they disagree about which moral principles offer the correct account of justified harm. (shrink)

This is the short version, in French translation by Anne Querrien, of the originally jointly authored paper: Müller, Vincent C., ‘Autonomous killer robots are probably good news’, in Ezio Di Nucci and Filippo Santoni de Sio, Drones and responsibility: Legal, philosophical and socio-technical perspectives on the use of remotely controlled weapons. - - - L’article qui suit présente un nouveau système d’armes fondé sur des robots qui risque d’être prochainement utilisé. À la différence des drones qui sont manoeuvrés à (...) distance mais comportent une part importante de discernement humain, il s’agit de machines programmées pour défendre, attaquer, ou tuer de manière autonome. Les auteurs, philosophes, préfèrent prévenir de leur prochaine diffusion et obtenir des Nations Unies leur régulation. Une campagne internationale propose plutôt leur interdiction. (shrink)

Many find it intuitive that those who use enhancements like steroids and Adderall in Olympic weightlifting and education are due less praise than those who perform equally well without using these enhancements. Nonetheless, it is not easy to coherently explain why one might be justifiably due less praise for using these technologies to enhance one’s performance. Justifications for this intuition which rely on concerns regarding authenticity, cheating, or shifts in who is responsible for the performance face serious problems. Santoni (...) de Sio et al., however, have recently defended a justification for this intuition which avoids the problems competing justifications face; the nature-of-activities justification. This justification relies on a conceptual analysis of the nature of activities and does not require the defense of any particular ethical stance concerning the use of enhancements. Santoni de Sio et al. claim that the success of the nature-of-activities account requires distinguishing between practice-oriented activities and goal-directed activities. I, however, show that this distinction is both deeply problematic and unnecessary. After exposing the weaknesses of Santoni de Sio et al.’s original account, I defend a simpler and less problematic version of the nature-of-activities account. The revised account is capable of both justifying this intuition of less praise and allowing one to determine when enhancements should be deemed permissible, impermissible, or obligatory for a given activity. (shrink)

En los más disímiles contextos universitarios, se generan hoy programas para mejorar los desempeños de los docentes en el proceso formativo; pero, infortunadamente estos no siempre resultan en un mejoramiento de la práctica cotidiana de las universidades, sobre todo en la calidad de la formación de los profesionales. De este hecho, el propósito del presente artículo está dado en realizar una valoración de las principales influencias epistemológicas en lo relativo a la profesionalización del docente universitario y develar aquellos desempeños idóneos (...) esenciales que deben poseer en este nivel de educación como expresión de las competencias que deben desarrollar. Today, in most diverse university contexts, programs are developed to improve the performance of professors in the educational process; but unfortunately, they do not always result in improving the daily practice of universities, especially in the quality of professionals training. Of this fact, the purpose of the present article is to carry out a valuation of the main epistemological influences related to the professionalization of universities` professors; and to determine the main essential suitable performances these professionals should have as an expression of the competences they must develop. (shrink)

The German philosophical culture of the Middle Ages is inextricable linked to the thought of Albert the Great. This volume brings together 14 papers, which deal with Albert's influence from the points of view of mysticism, philosophy, and the history of universities.